Efficiently identifying pareto solutions when objective values change

Copyright © 2014 ACMThe example code for this paper is available at https://github.com/fieldsend/gecco_2014_changing_objectivesIn many multi-objective problems the objective values assigned to a particular design can change during the course of an optimisation. This may be due to dynamic changes in the problem itself, or updates to estimated objectives in noisy problems. In these situations, designs which are non-dominated at one time step may become dominated later not just because a new and better solution has been found, but because the existing solution's performance has degraded. Likewise, a dominated solution may later be identified as non-dominated because its objectives have comparatively improved. We propose management algorithms based on recording single “guardian dominators" for each solution which allow rapid discovery and updating of the non-dominated subset of solutions evaluated by an optimiser. We examine the computational complexity of our proposed approach, and compare the performance of different ways of selecting the guardian dominators

A New Initialisation Method for Examination Timetabling Heuristics

This is the author accepted manuscript. The final version is available from IEEE via the DOI in this record.Timetabling problems are widespread, but are particularly prevalent in the educational domain. When sufficiently large, these are often only effectively tackled by timetabling meta-heuristics. The effectiveness of these in turn are often largely dependant on their initialisation protocols. There are a number of different initialisation approaches used in the literature for starting examination timetabling heuristics. We present a new iterative initialisation algorithm here --- which attempts to generate high-quality and legal solutions, to feed into a heuristic optimiser. The proposed approach is empirically verified on the ITC 2007 and Yeditepe benchmark sets. It is compared to popular initialisation approaches commonly employed in exam timetabling heuristics: the largest degree, largest weighted degree, largest enrollment, and saturation degree graph-colouring approaches, and random schedule allocation. The effectiveness of these approaches are also compared via incorporation in an exemplar evolutionary algorithm. The results show that the proposed method is capable of producing feasible solutions for all instances, with better quality and diversity compared to the alternative methods. It also leads to improved optimiser performance.Saudi Arabia Cultural Burea

Automated and Surrogate Multi-Resolution Approaches in Genetic Algorithms

This is the author accepted manuscript. The final version is available from IEEE via the DOI in this record.Recent work on multi-resolution optimisation (varying the fidelity of a design during a search) has developed approaches for automated resolution change depending on the population characteristics. This used the standard deviation of the population, or the marginal probability density estimation per variable, to automatically determine the resolution to apply to a design in the next generation. Here we build on this methodology in a number of new directions. We investigate the use of a complete estimated probability density function for resolution determination, enabling the dependencies between variables to be represented. We also explore the use of the multi-resolution transformation to assign a surrogate fitness to population members, but without modifying their location, and discuss the fitness landscape implications of this approach. Results are presented on a range of popular uni-objective continuous test-functions. These demonstrate the performance improvements that can be gained using an automated multi-resolution approach, and surprisingly indicate the simplest resolution indicator is often the most effective, but that relative performance is often problem dependant. We also observe how population duplicates grow in multi-resolution approaches, and discuss the implications of this when comparing algorithms (and efficiently implementing them).Shaqra University, Saudi Arabi

The Bayesian Decision Tree Technique with a Sweeping Strategy

The uncertainty of classification outcomes is of crucial importance for many safety critical applications including, for example, medical diagnostics. In such applications the uncertainty of classification can be reliably estimated within a Bayesian model averaging technique that allows the use of prior information. Decision Tree (DT) classification models used within such a technique gives experts additional information by making this classification scheme observable. The use of the Markov Chain Monte Carlo (MCMC) methodology of stochastic sampling makes the Bayesian DT technique feasible to perform. However, in practice, the MCMC technique may become stuck in a particular DT which is far away from a region with a maximal posterior. Sampling such DTs causes bias in the posterior estimates, and as a result the evaluation of classification uncertainty may be incorrect. In a particular case, the negative effect of such sampling may be reduced by giving additional prior information on the shape of DTs. In this paper we describe a new approach based on sweeping the DTs without additional priors on the favorite shape of DTs. The performances of Bayesian DT techniques with the standard and sweeping strategies are compared on a synthetic data as well as on real datasets. Quantitatively evaluating the uncertainty in terms of entropy of class posterior probabilities, we found that the sweeping strategy is superior to the standard strategy

Life on the Edge: Characterising the Edges of Mutually Non-dominating Sets

Copyright © 2014 Massachusetts Institute of TechnologyMulti-objective optimisation yields an estimated Pareto front of mutually nondominating solutions, but with more than three objectives understanding the relationships between solutions is challenging. Natural solutions to use as landmarks are those lying near to the edges of the mutually non-dominating set. We propose four definitions of edge points for many-objective mutually non-dominating sets and examine the relations between them. The first defines edge points to be those that extend the range of the attainment surface. This is shown to be equivalent to finding points which are not dominated on projection onto subsets of the objectives. If the objectives are to be minimised, a further definition considers points which are not dominated under maximisation when projected onto objective subsets. A final definition looks for edges via alternative projections of the set. We examine the relations between these definitions and their efficacy in many dimensions for synthetic concave- and convex shaped sets, and on solutions to a prototypical many-objective optimisation problem, showing how they can reveal information about the structure of the estimated Pareto front. We show that the “controlling dominance area of solutions” modification of the dominance relation can be effectively used to locate edges and interior points of high-dimensional mutually non-dominating sets

Visualising many-objective populations

Copyright © 2012 ACM14th International Conference on Genetic and Evolutionary Computation (GECCO 2012), Philadelphia, USA, 7-11 July 2012Optimisation problems often comprise a large set of objectives, and visualising the set of solutions to a problem can help with understanding them, assisting a decision maker. If the set of objectives is larger than three, visualising solutions to the problem is a difficult task. Techniques for visualising high-dimensional data are often difficult to interpret. Conversely, discarding objectives so that the solutions can be visualised in two or three spatial dimensions results in a loss of potentially important information. We demonstrate four methods for visualising many-objective populations, two of which use the complete set of objectives to present solutions in a clear and intuitive fashion and two that compress the objectives of a population into two dimensions whilst minimising the information that is lost. All of the techniques are illustrated on populations of solutions to optimisation test problems

Edges of Mutually Non-dominating Sets

Copyright © 2013 ACM. This is the accepted, peer-reviewed version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in Proceedings of the 15th annual conference on Genetic and Evolutionary Computation (GECCO ’13), pp. 607-614, http://dx.doi.org/10.1145/2463372.246345215th annual conference on Genetic and Evolutionary Computation (GECCO ’13), Amsterdam, The Netherlands, 6-10 July 2013Notes: Won the Best Paper Award in the EMO trackMulti-objective optimisation yields an estimated Pareto front of mutually non-dominating solutions, but with more than three objectives understanding the relationships between solutions is challenging. Natural solutions to use as landmarks are those lying near to the edges of the mutually non-dominating set. We propose four definitions of edge points for many-objective mutually non-dominating sets and examine the relations between them. The first defines edge points to be those that extend the range of the attainment surface. This is shown to be equivalent to finding points which are not dominated on projection onto subsets of the objectives. If the objectives are to be minimised, a further definition considers points which are not dominated under maximisation when projected onto objective subsets. A final definition looks for edges via alternative projections of the set. We examine the relations between these definitions and their efficacy for synthetic concave- and convex-shaped sets, and on solutions to a prototypical many-objective optimisation problem, showing how they can reveal information about the structure of the estimated Pareto front

Visualising Mutually Non-dominating Solution Sets in Many-objective Optimisation

Copyright © 2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.As many-objective optimization algorithms mature, the problem owner is faced with visualizing and understanding a set of mutually nondominating solutions in a high dimensional space. We review existing methods and present new techniques to address this problem. We address a common problem with the well-known heatmap visualization, since the often arbitrary ordering of rows and columns renders the heatmap unclear, by using spectral seriation to rearrange the solutions and objectives and thus enhance the clarity of the heatmap. A multiobjective evolutionary optimizer is used to further enhance the simultaneous visualization of solutions in objective and parameter space. Two methods for visualizing multiobjective solutions in the plane are introduced. First, we use RadViz and exploit interpretations of barycentric coordinates for convex polygons and simplices to map a mutually nondominating set to the interior of a regular convex polygon in the plane, providing an intuitive representation of the solutions and objectives. Second, we introduce a new measure of the similarity of solutions—the dominance distance—which captures the order relations between solutions. This metric provides an embedding in Euclidean space, which is shown to yield coherent visualizations in two dimensions. The methods are illustrated on standard test problems and data from a benchmark many-objective problem

Rank-based dimension reduction for many-criteria populations

Copyright © 2011 ACM13th annual conference on Genetic and Evolutionary Computation (GECCO '11), Dublin, Ireland, 12-16 July 2011Interpreting individuals described by a set of criteria can be a difficult task when the number of criteria is large. Such individuals can be ranked, for instance in terms of their average rank across criteria as well as by each distinct criterion. We therefore investigate criteria selection methods which aim to preserve the average rank of individuals but with fewer criteria. Our experiments show that these methods perform effectively, identifying and removing redundancies within the data, and that they are best incorporated into a multi-objective algorithm

Visualisation and ordering of many-objective populations

Copyright © 2010 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.We introduce novel methods of visualising and ordering multi-and many-objective populations. We compare individuals by the probability that one will beat another in a tournament on a randomly selected objective. This defines a weighted directed graph representing the population. We introduce a novel graphical representation of the many objective population based on Pareto shells. We examine leagues, Pareto shells, preference ordering, average rank, outflow, the stationary distribution and the power index for ordering the population finding that the average rank is equivalent to outflow and that these together with the power index are generally superior. Finally, we show how to seriate objectives to enhance the interpretability of heatmap visualisations